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The Kolmogorov complexity of a string is the length of its shortest description. We define a second quantised 
Kolmogorov complexity where the length of a description is defined to be the average length of its superposition. 
We discuss this complexity's basic properties. We define the corresponding prefix complexity and show that the 
inequalities obeyed by this prefix complexity are also obeyed by von Neumann entropy. 

I. INTRODUCTION 

Quantum physics is a more accurate description of physical phenomena than classical mechanics. If we therefore wish to 
speak about the complexity of some processes or some physical states in nature, it is more accurate to use a quantum mechanical 
model. An important question is (in very simple terms), given a physical system in some state, how difficult is it for us to 
reproduce it. If we wish to have a universal measure of this difficulty (which applies to all systems and states) a way to proceed 
is to follow the prescription of Kolmogorov. 

Kolmogorov complexity is a very general measure of information. The Kolmogorov complexity of a state is defined as the 
shortest description of that state on a universal computer. The intuition is that if a state can be described very succinctly, then 
that state is very simple, whereas complex states have very long descriptions. Kolmogorov complexity is a well-developed 
field with a plethora of applications in areas such as computer science, physics, pure mathematics and philosophy lfl2ll . In this 
paper, a second quantised Kolmogorov complexity based on average lengths of indeterminate length descriptions is defined. It is 
called second quantised because, as we shall explain, the physical interpretation of this complexity is of a system in the second 
quantisation. Its basic properties are then discussed; its physical interpretation, its incompressibility, the complexity of multiple 
copies of a state. We then define the corresponding prefix complexity and show that it is also incompressible, that it is related to 
von Neumann entropy, and that any inequality obeyed by the prefix complexity is also obeyed by von Neumann entropy. 

II. SYNOPSIS 

Section III describes the basic properties of classical Kolmogorov complexity. In Section IV, the related previous work in 
quantum information theory is described. In Section V, the second quantised Kolmogorov complexity based on average length 
descriptions is defined and its basic properties are discussed. In Section VI, the coiTesponding prefix Kolmogorov complexity 
is defined. It is shown that the complexity of a superposition is not additive and that the expected complexity of a mixture is 
closely related to its von Neumann entropy. 

III. CLASSICAL KOLMOGOROV COMPLEXITY 



Kolmogorov complexity is an information complexity based on the intuition that a simple string has a short description. The 
string 00000000000000000000, which can be described as "twenty O's", seems much simpler than say 10010111011010100010 
in which there is no obvious pattern (though one might exist). To avoid self-contradictory statements such as "the shortest string 
that cannot be described in less than one hundred words", Kolmogorov complexity is defined with respect to a Turing machine. 

Definition III.l (Kolmogorov complexity with respect to T) The Kolmogorov complexity of a string x can be defined with 
respect to a particular Turing machine T as the length of the shortest string p, which when inputted into T, outputs x. 

Ct(x) = min Up) 

Sometimes it is useful to be able to input two strings x and y into a classical Turing machine. However, x and y cannot be 
obtained from the string z = xy without encoding where the string x ends. Here is a simple way to encode a pair or a sequence 
of strings as input. 
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Definition III.2 (Encoding ordered sequences) For any pair of binary strings xi and X2, let 

(where 1" means n copies ofl). For any sequence of binary strings xi, X2, ■ ■ ■, Xm-i, Xm let 

{xi,X2,Xm-l, ■ ■ ■ ,Xm) = {xi, {X2, {■ ■ ■ {x 

)))) 

For example, (110, 1000) = 11101101000. Reading 11101101000 from left to right, the first three Is followed by a show that 
the first string has length 3. The next three bits give the value of the first string 110, the remaining four bits give the second string 
1000. 

An essential feature of Kolmogorov complexity is that it does not really matter which Turing machine is used to define it. The 
Kolmogorov complexity of a string x is invariant in the sense that there is a universal Turing machine U such that for any Turing 
machine T a constant exists which bounds Ct{x) — Cuix) for any x. 

Theorem III.3 (Invariance theorem) There is a universal Turing machine U such that for any Turing machine T there exists a 
constant ct ( dependent only on T and U ) such that for all x: 

Cu{x) <CTix) + CT 

Proof. Each Turing machine has a finite set of instructions, hence the set of all Turing machines can be enumerated. Let Ti, T2, 
... be an enumeration of the Turing machines. Let [/ be a Turing machine which on input {i,p), generates a description of the 
instructions of Turing machine Ti and simulates on input p (i.e. U{i,p) = T.i [p)). If p is a description of x on Turing machine 
Ti, then 

Cu{x) < l{p) + CT 

where ct is a constant, independent of x, dependent on the number of bits used to describe i. □ 

Let us now fix the universal Turing machine U in the invariance theorem, and define Kolmogorov complexity with respect to 
this reference machine U. 

Definition III.4 (Kolmogorov complexity) The Kolmogorov complexity of a string x is defined as the shortest description of x 
with respect to the universal Turing machine: 

Cix) = min Up) 

where U is the fixed universal Turing machine as in the Invariance Theorem (Theoretii \III.3\) . 

Sometimes it is also useful to define the complexity of x conditional on knowing another string y. For example, conditional 
complexity can be used to define how much information y provides about x. 

Definition III.5 (Conditional Kolmogorov complexity) The conditional Kolmogorov complexity of a string x given a string y 
is defined as 

C{x\y) = min l{p) 

U(y,p)=x 

where U is the fixed universal Turing machine as in the Invariance Theorem (Theorem \III.3\) . 



A. Incompressibility 

Many "long strings" have short descriptions. For example, there is a Turing machine T that outputs 2 on input 71, so for 
all n, 2^^ can be described using log(n) + c bits. One might hope that many large strings can be described by short strings. 
However, the incompressibility theorem shows that not all strings are compressible. 

Theorem III.6 (Incompressibility theorem) For any integer n > 0, there is at least one string x of length l(x) = n which has 
a Kolmogorov complexity is at least n. 

Proof. The proof of the incompressibility theorem is a simple pigeon hole argument. There are 2" strings of length n but only 
2° + . . . + 2"^^ < 2" strings of length less than n. Therefore at least one string of length n cannot be compressed to a string of 
length less than n. □ 
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B. Prefix Kolmogorov Complexity 

The standard Kolmogorov complexity C which has been described so far does not deal with prefix free strings. Kolmogorov 
complexity can be related simply to Shannon entropy by defining a prefix Kolmogorov complexity K where the descriptions are 
prefix free. 

Another advantage of prefix complexity over standard complexity is that K is additive, that is K{x, y) < K{x) + K{y) + c 
(since (.t, y) can be described by concatenating prefix free descriptions of .t and y). On the other hand, C(.t, y) < C{x)+C{y)+c 
does not hold in general lfl2ll . There are (n + 1)2" pairs {x, y) such that l{x) + l{y) = n. Thus by incompressibility, there exists 
at least one such pair {x, y) that has complexity 

C{x,y) > log((n + l)2") (1) 
= n + log(n) (2) 
> n + c (3) 
= lix) + l{y)+c (4) 
= Cix)+Ciy) (5) 

1. Prefix Kolmogorov Complexity 

In order to define prefix Kolmogorov complexity, in which the descriptions are prefix free, let us define a prefix quantum 
Turing machine. 

Definition III.7 (Prefix Turing machine) T is a prefix Turing machine if any two inputs x and y upon which T halts are prefix 
free. 

This definition is equivalent to restricting all inputs to be infinite length and defining the length of the input to be the number 
of bits on the input tape that are used during computation. A universal prefix Turing machine U can be defined by enumerating 
the Turing machines Ti, T2, . . . and using self-delimiting descriptions of each Turing machine. In this way, prefix Kolmogorov 
complexity is invariant up to an additive constant. 

Definition III.8 (Prefix Kolmogorov complexity) The prefix Kolmogorov complexity K of a string x is: 

Kix) = min Up) 

U{p)=x 

where U is the reference universal prefix machine. 

2. Prefix Kolmogorov Complexity and Shannon Entropy 

The expected prefix complexity of a random variable is closely related to the random variable's Shannon entropy. The expected 
prefix complexity of a random variable is defined as its average prefix complexity. 

Definition III.9 (Expected prefix Kolmogorov complexity of a random variable) Let X bea random variable. The expected 
prefix Kolmogorov complexity of X is: 

E{K{X)) = Y,P{X^x)K{x) 

X 

On the other hand, the complexity of a random variable X is the complexity of describing X itself, given some suitable encoding. 

Definition III.IO (Prefix Kolmogorov complexity of a random variable) Given a random variable X, let f{X) be an encod- 
ing ofX if 

f{X) = {{pi,Xi), . . . {p,n,Xm)) 

where Xi < X2 < ■ ■ ■ < Xm and for all x with P{X = x) > 0, there exists a unique 1 < i < m such that x = .t,; and 
Pi = P(X = x). The prefix Kolmogorov complexity of X is the prefix Kolmogorov complexity of its encoding: 

K{X)^K{f{X)) 
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Since a compression algorithm can be implemented by a Turing machine, E{K{X)) and H{X) are closely related. 
Lemma III.ll (Relationship between H and K) There exists a constant c such that for any random variable X, 

E{K{X)) - K{X) - c< H{X) < E{K{X)) 

Proof. By Shannon's Noiseless Coding Theorem for Lossless Codes lEsll . there is no prefix free encoding of X whose expected 
length is less than X, thus E{K{X)) > H{X). On the other hand, by describing the random variable X, a prefix code F which 
encodes X using E{F{X))) = H{X) + 1 bits can be described. Thus E{K{X)) < H{X) + K{X) + c. □ 



IV. PREVIOUS WORK 

In this section, the previous attempts to define a quantum Kolmogorov complexity and some of the previous work on indeter- 
minate length quantum strings are described. The first attempt to define a quan tum Kolmogorov complexity was by Svozil ll29ll 
in 1996. The attempts to define a quantum Kolmogorov complexity ||3l0, assume that the descriptions 

have determinate lengths. Second quantised Kolmogorov complexity differs from the others in that it uses indeterminate length 
quantum strings. 

A. Indeterminate Length Quantum Strings 

Indeterminate length quantum strings have been discussed in the context of lossless quantum data compression lflll4l l23[ l26ll . 
When a mixture of non-orthogonal strings is compressed using a variable length string, the resulting compressed state may be in 
a superposition of different lengths. Such a string is called an indeterminate length string ll26ll . 

Definition IV.l (Indeterminate lengtli string) \^) = oti\i) is an indeterminate length quantum string if there exists i and j 
with \ai\ > and \aj\ > and l{i) ^ 

Determinate length strings of length n exist in the Hilbert space iJ®". Indeterminate length strings exist in the Fock space 

oc 
n=Q 

The analysis of indeterminate length strings in the Fock space has recently been discussed lEoll . It was shown that an inde- 
terminate string in the Fock space H® can be considered as a string on a quantum Turing machine, where a finite set of cells 
beginning from the first cell are non-blank. The other cells contain the character |#) which is orthogonal to |0) and 
Bostrom and Felbinger 01 defined two ways to quantify the lengths of indeterminate length strings. 

Definition IV.2 (Lengtlis of indeterminate lengtli strings) The base length L of an indeterminate length string is the length of 
the longest part of its superposition 

L\y aAi) \ = max 

The average length I of an indeterminate length quantum string is the average length of its superposition 

If the length of a quantum string is observed, then I is the expected length that is observed and L is the maximum length that can 
be observed. 
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1. From Lossless Coding to Lossy Coding 

Schumacher and Westmoreland ll26ll demonstrated that by projecting onto n{S{£) + S) qubits, if a mixture is encoded 
with a variable length condensable code, a fixed length lossy code can be obtained la]. If £ is a mixture with density operator p, 
where p's spectral decomposition is: 

i 

Then £ can be encoded by encoding each \i) as a prefix free string of length [— log(pj)] with zero-padding, p®" can be encoded 
in the same fashion. Almost every string \i) in the typical subspace of p®" has probability arbitrarily close to 2""'^'^''^ as n 
grows large. Thus almost every string in the typical subspace of p is encoded as a string of length arbitrarily close to nS{p). 
By projecting onto n{S{p) + 6) qubits, the compressed state is projected onto the encoded typical subspace of p. The typical 
subspace can be decoded to obtain the original mixture £ with arbitrarily high (but not perfect) probability and fidelity. Thus the 
minimum expected average length of a variable length code is related to von Neumann entropy. 

From this encoding, it can be seen that the average lengths of condensable codes obey Kraft's inequality (if they did not, then 
a mixture could be lossily compressed to less than its von Neumann entropy). 

Lemma IV.3 (Kraft's inequality for condensable strings) IfS, is a set of orthogonal condensable strings then 

J2 2-'(l'^» < 1 

Proof. Let ^ — {{"ipi), ■ ■ ■ , li^n)} be a set of orthogonal condensable strings and let 

n 

Let p be density operator defined by: 



In)) 

i=l 



c 

Then the expected average length of p is: 

' (7) 

c 

(8) 

As discussed above, it is possible to design a lossy quantum code which has rate of compression E{l{p)). If c > 1 then 
E(J{p)) < S{p). Therefore c < 1 as required. □ 



B. Quantum Kolmogorov Complexity 

Berthiaume, van Dam and Laplante lUt] defined a quantum Kolmogorov complexity based on Bernstein and Vazirani's model 
of a quantum Turing machine l|2|l. This quantum Kolmogorov complexity is invariant up to an additive constant with respect to a 
universal quantum Turing machine U which can simulate any other quantum Turing machine from its classical description. The 
quantum Kolmogorov complexity QC was defined as the base length of its shortest quantum description on U 

QCIV') = min L{p) 

U{p) = \ip) 

It was shown that the complexity of n copies of a state jV') is at most 

QC(IV)^") < log - 1 j + 0{\og{n)) + 0{log{QCm) 
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The first term is the logarithm of the dimensions of the symmetric subspace where Hp is the space containing the shortest 
description of \ip), p. The second term comes from describing n in a self-delimiting way. The third term comes from describing 
dim{Hp) — \og{QC {\tjj)) in a self-delimiting way. The second and third terms contain a big-O term since the descriptions of n 
and dim(gp) are self-delimiting so that they can be concatenated together with the symmetric vectors. 

Miiller lll7i[l9ll studied the precise definition of quantum Kolmogorov complexity in detail, and gave a detailed analysis of the 
invariance theorem of quantum Kolmogorov complexity. He showed that there is a universal reference Turing machine U that 
can simulate another quantum Turing machine T using a constant number of qubits, even if T and U have access to a different 
finite sets of gates (given that the time of computation is not known in advance). Miiller ifisll also gave a detailed proof that 
classical strings have the same classical and quantum Kolmogorov complexities up to an additive constant factor 

C. Quantum Kolmogorov Complexity based on Classical Descriptions 

Vitanyi lf32ll defined a prefix quantum Kolmogorov complexity based on classical descriptions. The idea behind this com- 
plexity is as follows. Suppose that \p) is a self-delimiting classical input to a quantum Turing machine T which outputs a state 
T\p) ~ 10) and that \^) is some state close to 10). It can be said that \p) is a description of \tp) but a penalty factor can be added 
depending on the distance between \^) and 10). Suppose \^) ~ a\<j>) + f3\(j)-^) where is orthogonal to |0). Then the idea 
is that 10) can be described by using an additional log(|/3^|) to encode 10-^) using lossless compression. Thus log(|/3^|) is the 
penalty factor depending on the distance between \tjj) and |0) . The conditional prefix free string complexity Kq of a string 1 0) 
was defined as: 

^q(I^) \y) = ^, niin (l{p) + \- log(| (^-10) ni ) 

The first term l{p) is the length of the shortest program, the second term is the number of bits used to encode the orthogonal 
state to 10). 

This complexity can be understood by considering an example. 
Example IV.4 (Quantum Kolmogorov complexity base on classical descriptions) Consider describing the state 



as |0). Then the complexity of\ipn) is 



ifgd^O) = log(c) - log(l/2) (9) 
= k (10) 



where c and k are constants independent of n. 
More generally, any state 



IV')-E' 



can be described by describing the easiest part \i) of and incurring a — log(l — la; P) penalty so that the complexity (based 
on classical descriptions) of is bounded by 

KqM) < min(A-(z) + log(l - \a,\^)) 



D. Application of Classical Kolmogorov Complexity to Quantum Computation 

There have been several papers IM [H [M [H [H, m which apply classical Kolmo gorov complexity directly to quantum 
mechanics. Laplante and Magniez lUlll used Kolmogorov complexity to study lower bounds for randomized and quantum query 
complexity. Laplante, Lee and Szegedy ifioll also used classical Kolmogorov complexity to study quantum algorithms. They 
produced new results in quantum computational complexity. Laplante, Lee and Szegedy showed that the quantum adversary 
argument can be used on formula size lower bounds. Thus using results in quantum computing, they produced new results in 
classical computational complexity. 
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Svozil ll29ll was the first to discuss defining a quantum Kolmogorov complexity back in 1996. Svozil used a circuit based model 
of quantum computation, and said that descriptions must be classical, so that the prefix complexity obeys Kraft's inequality. 
In the sense that the descriptions are purely classical, this is an application of classical Kolmogorov complexity to quantum 
information theory. Svozil described the basic properties of this complexity. 

Mora and Breigel lITiifTsIl also used classical Kolmogorov complexity to define the complexity of quantum states. According 
to Mora and Briegel, an important feature of a description of a quantum object is that the description can be copied Hill , therefore 
a quantum description is necessarily not quantum, but classical. Therefore Mora and Briegel lITil [Tsll defined the algorithmic 
entropy of a quantum state to be the classical Kolmogorov complexity of a circuit that describes the quantum state up to a 
given degree e (unfortunately this complexity increases beyond a constant factor as e decreases). Mora and Briegel showed that 
the algorithmic complexity of a quantum state can be bounded in terms of the Schmidt number of its entanglement (although 
the converse does not hold). Mora, Briegel and Kraus lfl6ll applied algorithmic complexity to various problems in quantum 
communication and computation to produce new proofs of already known results. An application of a quantum Kolmogorov 
complexity would be to analyse a fully generalised quantum Maxwell's demon ll24ll . Mora, Briegel and Kraus lfl6ll also applied 
the algorithmic complexity of quantum states to begin to look at the effect of entanglement on Maxwell's demon. 



E. A Priori Probability 

Gacs ||7tl and Tadaki llsollsill both defined quantum Kolmogorov complexity Uke measures based on probability theory. Gacs 
attempted to define a universal probability measure, which unfortunately does not correspond to any length measure 1I32I1 . Tadaki 
llsill extended the semi-POVM to infinite dimensions and derived a quantum generalisation of Chaitin's halting probability jsl 
as the probability of any measurement outcome on the maximal infinite dimensional semi-POVM. 



V. SECOND QUANTISED KOLMOGOROV COMPLEXITY 

There have been many attempts to define a quantum analogy of classical Kolmogorov complexity ll3l [7|[l4ll27[l29[l30ll3ll[32ll . 
In this paper, a modification of the scheme proposed in Berthiaume, van Dam and Laplante yl is taken ll22ll24ll . 

As is usual in quantum information theory, Berthiaume et al assume that quantum strings are not in superpositions of different 
lengths. However, a quantum string might be in a superposition of a very simple string and a very complex string, in which case, 
its "shortest description" seems to naturally be a superposition of a very short string and a very long string. Therefore it seems 
natural to allow the shortest description to exist in a superposition of different lengths. The length of the shortest description is 
defined to be its average length. 

Second quantised Kolmogorov complexity can be defined with respect to a specific Turing machine T. 

Definition V.l (Second quantised Kolmogorov complexity with respect to T) The second quantised Kolmogorov complexity 
QCrp of a string lip) with respect to a quantum Turing machine T is: 

= ^ min 7(10)) 

Each quantum Turing machine has a finite number of instructions. The quantum Turing machines can therefore be enumerated 
and a reference universal Turing machine can be defined using this enumeration. In this definition, |l''*'Oi) is simply a prefix 
free description of i. 

Definition V.2 (Reference universal quantum Tiiring machine) Let Ti, T2, . . . be a enumeration of the quantum Turing ma- 
chines. On input {i, ji/;)) = jl^-^'Oi) ® |V'), the reference universal quantum Turing machine simulates Ti on input 

The general second quantised complexity can be defined with respect to this reference universal quantum Turing machine. 

Definition V.3 (Second quantised Kolmogorov complexity) The second quantised Kolmogorov complexity QC of a string jV') 
is defined the minimum average length of a description of\^j) with respect to the reference quantum Turing machine U. 

QC(|^))= min 7(10)) 

ui\4>))=m 

The conditional second quantised Kolmogorov complexity C of a string [ip) given a string \x) is: 

QCmWx)) = min 7(10)) 
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1. Invariance 

Following the same reasoning for classical Kolmogorov complexity, second quantised Kolmogorov complexity is invariant up 
to an additive constant (for simplicity, it is assumed that all quantum Turing machines have access to the same set of universal 
gates). 

Lemma V.4 (Invariance) Let T be any quantum Turing machine. Then there exists a constant c^, dependent only on T, such 
that for any state j'i/'), 

QC{m<QCTm)+cT 

2. Examples 

A simple example of second quantised Kolmogorov complexity is the complexity of 

\(j)n) ^ + p\n) 
which is given by the average complexity of the two parts, |0) and \n) : 

QC(|0„))< |/3|2[log(n)l +c 

Unlike Berthiaume et aFs quantum Kolmogorov complexity, the second quantised complexity of |(/)„) is continuous at \/3\ 
Another simple example of second quantised Kolmogorov complexity is to bound the complexity of a state from above by its 
average length, using the identity machine. 

Lemma V.5 (Upper bound on complexity) There exists a constant c such that for any string 

Qcim<-i{m+c 

Proof. Let be the identity quantum Turing machine which copies its input to the output tape. Then there exists some j such 
that = Tj where Ti, T2, . . . is the enumeration of quantum Turing machines used in the definition of the reference universal 
quantum Turing machine. On input l'(^'Oj|'0), the universal quantum Turing machine outputs \tp). Thus any state \tp) can be 
described using at most + "^lij) + 1 qubits. □ 



A. Second Quantised Kolmogorov Complexity as Energy 

Rallan and Vedral described a physical interpretation of the average length of indeterminate length strings as energy in a system 
in the second quantization 1I21I1 . This gives second quantised Kolmogorov complexity an intuitive physical interpretation. 

A Hilbert space iJ®" can be realised by a sequence of photons \(f)i) ^ . . . (E) \(j>n) in which represents exactly one photon 
with frequency The value of the qubit \(pi) is realised by the polarisation of its photon, either horizontal |0) or vertical The 
absence of a photon at a particular frequency can be represented by |#) which is orthogonal to |0) and Indeterminate length 
strings are obtained by allowing the number of photons to exist in superposition and ordering the photons by their frequencies. 
The first |#) (which can be in a superposition of positions) is used to mark the end of the string. 

The frequency of each photon \(j>i) is chosen to be approximately equal so that uji Ri uj for some value uj. The energy in a 
superposition of photons is the average energy required to either create or destroy that superposition {huj per photon of frequency 
UJ where h is Planck's constant). Thus the energy of an indeterminate length string of photons 10) is proportional to its average 
length and is given by (approximately) fkul{\(j))). The average length of an indeterminate length quantum string is therefore 
proportional to the energy within the string. 

In this physical implementation of quantum mechanics, the second quantised Kolmogorov complexity of a state represents 
the minimum energy required to describe that state. 

B. Incompressibility 

A fundamental property of classical Kolmogorov complexity is that it is incompressible. Second quantised Kolmogorov 
complexity is also incompressible in the sense that it is not possible to compress a set of quantum strings arbitrarily. This 
incompressibility theorem is analogous to the incompressibility theorem given by Berthiaume et al 13^. 
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Theorem V.6 (Incompressibility) Let . . ., lipm) be quantum strings (which are possibly non-orthogonal). Then there 
exists 1 < i < m such that: 



mm > 



where p = J^jLi ^ I- 



Proof. The result is an application Schumacher and Westmoreland's average length compression scheme Il26ll (which was 
described in Section lTV A lb . They showed that given a mixture of states 

£ = {(l/m,|^,))}™i 

if U is any prefix free encoding of the \ipi)'s then the expected average length after compression is bounded below by p's von 
Neumann entropy: 

ECiiuis))) = j2l.-iium)) (11) 

i 

> S{p) (12) 
(where p is defined as in the theorem). Since E(1{U{£))) > S{p), it must be the case that for some i, 

I(C/(|V'.») > S{p) 

So far, it has been assumed that U is prefix free. Suppose that £ is compressed using a variable length unitary code V (which is 
not necessarily prefix free). Let S be the unitary operation 

S\x) = |l'(")Oa;) 

so that S transforms each string \x) into a self-delimiting string 5*12;). In which case, SV is a prefix free mapping. Using Eq. 
IV Bl there is some \ipi) such that; 

21{V{\^,))) + 1 = (13) 
> S{p) (14) 

Rearranging gives the result. □ 

The bound in the theorem can of course be improved by choosing a more efficient encoding of the length information in the 
proof (i.e. choosing a different function S). 

C. Complexity of Multiple Copies 

A simple but non-trivial example of second quantised Kolmogorov complexity is the complexity of n copies of a qubit. The 
second quantised complexity of n copies can be much smaller than the corresponding quantum Kolmogorov complexity of 
Berthiaume et al Jst]. 

Theorem V.7 (Complexity of Multiple Copies) Let 

IV) =a|0)+/3|l) 

Let X be a random variable such that for < i < n: 

P{X = i) = |a|2'|/3|2("-») 

Then, given n, the conditional complexity o/ ji/;)®" is at most: 

C{m^)\\n))<H{X) + cx 

where cx is dependent on X but not on n. 
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Proof, n copies of \ip) can be expanded out as: 

= (a|0) (15) 

71 

= Y.a'P"-'S{i,n) (16) 

1=0 

where S{i, n) is the symmetric superposition of strings containing i |0)'s and n — i |l)'s. Given n and a description of X, each 
S{i,n) can be described as a string of length log(|a'/3"~'p) qubits. Thus each \ip^'^) can be described using H{X) + cx qubits, 
where the constant cx comes from describing the probabiUty distribution X. □ 

This bound is not tight. If some state is close to |+), then H(X) is large however if a basis change is performed (using n 
Hadamard operations) from {|0), |1)} to {|— ), |+)}, then H{X) is dramatically reduced in this basis. 



VI. PREFIX COMPLEXITY 



A prefix Kolmogorov complexity can be defined by defining a prefix quantum Turing machine which takes as input prefix free 
strings. 

Definition VI.l (Prefix quantum Turing macliine) A quantum Turing machine T is a prefix quantum Turing machine if any 
two orthogonal inputs to T are prefix free. 

As with classical Kolmogorov complexity, all inputs can be defined to have infinite length, and the average of the maximum 
lengths of the number of qubits used (on the input tape) during computation can be defined to be the length of the input. The 
prefix quantum Turing machines can then be enumerated to define a reference universal prefix quantum Turing machine in the 
same manner as for classical Kolmogorov complexity lfT2ll . A prefix complexity can be defined with respect to the reference 
prefix Turing machine. 

Definition VI.2 (Second quantised prefix Kolmogorov complexity) Let U be the universal reference prefix quantum Turing 
machine. The second quantised prefix Kolmogorov complexity QK of a state |^/;) is: 

u\4>)=m 



A. Incompressibility 

In proving the incompressibility theorem for the non-prefix complexity (Theorem lV.6b the incompressibiUty theorem for prefix 
complexity has inadvertently been proved. Here it is. 

Tlieorem VI.3 (Incompressibility of prefix complexity) Let . . ., \ipm) be quantum strings (which are possibly non- 

orthogonal). Then there exists 1 < i < m such that: 

mm) > s{p) 

where p ^ J2"Li Tri\^^)(^^\- 

Proof. See proof of Theorem lV.6l □ 



B. Relationship of Prefix Complexity to von Neumann entropy 

Since the expected average length of an optimal encoding of a mixture is its von Neumann entropy, prefix complexity is 
related to von Neumann entropy. Let us define the expected complexity of a density operator in the same way that it is defined 
classically. 

Definition VI.4 (Expected prefix Kolmogorov complexity of p) Let 

p = '^Pi\'4'i){iPi\ 

i 

be a density operator in its diagonalised form. The expected prefix Kolmogorov complexity of p is: 

i?(Q¥(p)) = ^p,Q¥(|^,)(V,;|) 

i 
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A density operator may have more than one possible diagonalisation. The complexity of a density operator is therefore defined 
to be the minimum complexity of describing a mixture that corresponds to that density operator 

Definition VI.5 (Prefix Kolmogorov complexity of p) Let £ = {(pi, iV'i))} be a mixture of quantum states. Let < be a total 
ordering on quantum states and without loss of generality, suppose that < \il)2) < • ■ ■ < I^Am)- An encoding f of £ is: 

/(5) = ((pi,|^.i)),...,(p,„,|^™))) 

The second quantised prefix Kolmogorov complexity of£ is defined as: 

The second quantised prefix Kolmogorov complexity of a density operator p is defined as: 

QK{£) = mill QK{f{£)) 

e = {{:p,^^|^,)],a„dY.,P^\i'^)m=P 

The relationship between von Neumann is the same as for Shannon entropy and classical prefix complexity. 

Tlieorem VI.6 (Relationsfiip of S and QK) Let £ = {(Pi, iV'i))} be a mixture of quantum states with density operator p. Let 

i 

Then there exists a constant c, independent of p, such that 

E{QK{p)) - QK{p) - c < S{p) < EiQKip)) 



Proof. By Schumacher and Westmoreland's result 112611 . if £ is encoded by a prefix free encoding, then the expected average 
length of that prefix free encoding is bounded below by the von Neumann entropy of the mixture's density operator Since the 
orthogonal inputs to a prefix Turing machine are prefix free, their expected length is bounded below by S{p). On the other hand, 
an expected length of S{p) + 1 qubits can be achieved by encoding p in its diagonal basis. There exists a Turing machine Tp 
(which can be described using approximately QK{p) qubits) which carries out this encoding, hence the result follows. □ 



C. Additivity of Superpositions 

The incompressibility theorem (Theorem lV1.3b can also be used to show that prefix second quantised Kolmogorov complexity 
is not additive in the sense that the complexity of a superposition is not bounded above or below by the complexity of its parts. 
In other words, the following two inequalities do not hold. 

QK{^c^^\^^)^ < ^|a,|W(IV'.»+c (17) 

QK(^a^\^^)^ > (18) 

This additivity does not hold even when the states in the superposition are restricted to being orthogonal. 

Theorem VI.7 (Non-additivity of second quantised complexity) For any constant k > 0, there exist orthogonal states \tpi), 
\1Jj2), ■ ■ ; IV'n) and constants ai, . . ., an such that 

For any constant fc > 0, there exist orthogonal states Itpi), \il'2), ■ ■ ■, | V'n) ^^^d constants ai, . . ., an such that 
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Proof. For n > 0, let 



l^i) ^ ^ (.9) 

l« - (20) 

(>) For each m, consider the states |2™), . . ., |2™+^ — 1). By the incompressibility theorem above, there exists some 2"' < 
n < 2™+i such that 

m{\n)) > ^(|' e"4!^) (21) 

= m (22) 

= Llog(")J (23) 



On the other hand 



But by Lemma rv31 



2^-^(1^)) + 2^-^(1'^"/) ^ ^ + c (24) 



^ log("-) 
2 

Thus for any constant fc, there exists sufficiently large n such that: 



72 



(<) By Lemma|V31 

Qi?(|0)) <c 

On the other hand, there exists sufficiently large N such that the density operator 



N 



(25) 



Qj^f l^i) \^n) \ ^ QKQn)) (26) 



> Llog(")J (27) 

> '-^ + c + k (28) 



has arbitrarily high entropy S{p). Therefore, by the incompressibility theorem, for any constants c and k there exists n such that 
> 2(c + k). For this n: 

W|0)) < c (30) 

< ^ k (31) 

^ gX(|<;6+))+Qir(|0-)) ^^2) 

which completes the proof. □ 
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D. Inequalities of Von Neumann Entropy 



It has been shown that the same inequalities hold for classical Kolmogorov compl exity and Shannon entropy and that the 
same inequalities hold for classical Kolmogorov complexity and the size of sets ||3,|25|]. However, very little is known about 
the inequalities for von Neumann entropy and most of the known inequalities for von Neumann entropy can be derived from 
subadditivity lfl3ll . We now show that the inequalities obeyed by second quantised prefix complexity are also obeyed by von 
Neumann entropy. 

To discuss general inequalities, we first define some notation. For this, we follow Hammer, Romashchenko and Vereshchagin 
lH]. Let pXi0-<»x„ ^ ^ ^ ^ ,ig,p^" be any rt-partite state state in the Hilbert space . . .(K)X„. For any T/F C {1, . . . , n}, 
let 



Then, since conditional and mutual entropies can be expanded out as the sums of joint entropies, any inequality of von Neumann 
entropy can be written as 



J2 xwS{p'^n>o 



wez 

for some n, for some Hilbert space (g) . . . ® p"^" and for some set Z of subsets of {1, . . . ,n} where the A^y's are real 
constants. 

Theorem VI.8 (Inequalities of von Neumann entropy) Let Z be a set of subsets o/ {1, . . . , n}. For each subset W of 
{1, . . . , 7T,}, let \w be some real constant. Then if: 

wez 

holds for all n-partite spaces Xi ... (8) Xn and for all states p G Xi ® . . .® X„, then the inequality 

XwS{p'^n>Q 

also holds for all density operators p in all n-partite spaces X\ ® . . .® X„. 

Proof. Let p be any density operator in some n-partite space Xx® . . .® X^- Then for each set Vl^ C {1, . . . , rt} and each 
integer to > 0: 

mSip^"") = (33) 
= s{^{p''^)®A (34) 

\i£W J 

Let y/" = Xf" (we shall apply Eq. |VL8]to Wy-^ rather than Wx). Then 

to5(p^-) ^ ^((g)(p^*)®") (35) 

= ^((8)/''^' j (36) 

Kidw ) 

= (37) 
Now can be described by describing m, p and W . Thus 



to 



g(Qg((p^")'^^"' )) + 0(log(TO)) + cp + 0{n) 

TO 



(39) 
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And so, as m grows large, 

y XwSip'^n = y E{QK{{p^n'^^-)) + 0(log(m)) + c, + 0(n) 

^ V A^.g^""""'""-' (40) 
^-^ m 

wez 

(41) 

Assuming that the corresponding inequality holds for second quantised complexity for all states p in all n-partite spaces (Eq. 
IV1.8I ). as m grows large 

^ ,„si,^.) ^ j2 ,„ m,»-r'-)) ,,,, 

wez wez 
> 

□ 



VII. CONCLUSIONS 



We have defined a second quantised Kolmogorov complexity that has an intuitive physical interpretation. We have discussed 
its basic properties. We have also shown that the second quantised prefix complexity is closely related to von Neumann entropy. 
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